SASSI — Super-Pixelated Adaptive Spatio-Spectral Imaging

نویسندگان

چکیده

We introduce a novel video-rate hyperspectral imager with high spatial, temporal and spectral resolutions. Our key hypothesis is that profiles of pixels within each super-pixel tend to be similar. Hence, scene-adaptive spatial sampling scene, guided by its segmented image, capable obtaining high-quality reconstructions. To achieve this, we acquire an RGB image the compute super-pixels, from which generate mask locations where measure high-resolution spectrum. The subsequently estimated fusing measurements using learnable filtering approach. Due low computational complexity superpixel estimation step, our setup can capture images scenes little overhead over traditional snapshot cameras, but significantly higher validate proposed technique extensive simulations as well lab prototype measures video at resolution $600 \times 900$ 600 × 900 pixels, 10 nm visible wavebands, achieving frame rate 18fps.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Sparse Spatio-spectral Representation for Hyperspectral Image Super-resolution

Existing hyperspectral imaging systems produce low spatial resolution images due to hardware constraints. We propose a sparse representation based approach for hyperspectral image super-resolution. The proposed approach first extracts distinct reflectance spectra of the scene from the available hyperspectral image. Then, the signal sparsity, non-negativity and the spatial structure in the scene...

متن کامل

Direct spatio-spectral datacube reconstruction from raw data using a spatially adaptive spatio-spectral basis

Spectral reflectance is an inherent property of objects that is useful for many computer vision tasks. The spectral reflectance of a scene can be described as a spatio-spectral (SS) datacube, in which each value represents the reflectance at a spatial location and a wavelength. In this paper, we propose a novel method that reconstructs the SS datacube from raw data obtained by an image sensor e...

متن کامل

Adaptive spectroscopy: towards adaptive spectral imaging

Spectral imaging is an emerging tool for defense and security applications because it provides compositional information about the objects in a scene. The underlying task—measuring a 3-D dataset using a 2-D detector array—is challenging, and straightforward approaches to the problem can result in severe performance tradeoffs. While a number of ingenious (non-adaptive) solutions have been propos...

متن کامل

Endoscopic Depth Measurement and Super-Spectral-Resolution Imaging

Intra-operative measurements of tissue shape and multi/ hyperspectral information have the potential to provide surgical guidance and decision making support. We report an optical probe based system to combine sparse hyperspectral measurements and spectrally-encoded structured lighting (SL) for surface measurements. The system provides informative signals for navigation with a surgical interfac...

متن کامل

Adaptive Spatio-Temporal Restoration for 4D Fluorescence Microscopic Imaging

We present a spatio-temporal filtering method for significantly increasing the signal-to-noise ratio (SNR) in noisy fluorescence microscopic image sequences where small particles have to be tracked from frame to frame. Image sequence restoration is achieved using a statistical approach involving an appropriate on-line window geometry specification. We have applied this method to noisy synthetic...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Pattern Analysis and Machine Intelligence

سال: 2021

ISSN: ['1939-3539', '2160-9292', '0162-8828']

DOI: https://doi.org/10.1109/tpami.2021.3075228